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NEW DIVISORS IN THE BOUNDARY OF THE INSTANTON 

MODULI SPACE 
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Abstract. Let X{n) denote the moduli space of rank 2 instanton bundles 
of charge n on We know from [^ 1121 fT^ I2Q| that X{n) is an irreducible, 
nonsingular and affine variety of dimension 8 n—3. Since every rank 2 instanton 
bundle on P^ is stable, we may regard X{n) as an open subset of the projective 
Gieseker-Maruyama moduli scheme Ai{n) of rank 2 semistable torsion free 
sheaves F on P^ with Chern classes ci = C 3 = 0 and C 2 = n, and consider the 
closure X{n) of X(n) in A4{n). 

We construct some of the irreducible components of dimension 8 n — 4 of 
the boundary dX{n) := X(n) \ X(n). These components generically lie in the 
smooth locus of A4(n) and consist of rank 2 torsion free instanton sheaves with 
singularities along rational curves. 


1. Introduction 

A mathematical instanton of charge n is a holomorphic rank 2 vector bundle E 
on the projective space with Chern classes 

(1) ci(£;) = 0, C 2 {E)=n, 
satisfying the vanishing conditions 

(2) h\E{-l)) = h\E{-2)) = Q. 

The epithet “mathematical”, which will be omitted in the remainder of the paper, 
distinguishes these objects from physical instantons. The latter are anti-self-dual 
S'17(2)-connections on S'^, which give rise, by the Atiyah-Ward correspondence, to 
vector bundles E as above with some additional “reality” conditions. 

We denote by I(n) the moduli space of instantons of charge n. Nowadays it is 
known that I{n) is a nice variety possessing some natural properties which were 
conjectured long ago, but whose proof remained an open problem for many years: 
I(n) is affine [5], nonsingular |12j . and irreducible of dimension 8n — 3 [Bun]. 
Since every instanton is /i-stable and /i-stability is the same as Gieseker stability 
for rank 2 bundles, I(n) can be regarded as an open subset within the projective 
Maruyama moduli space A4 in) of Gieseker semistable rank 2 sheaves E on with 
ci(F) = C 3 (F) = 0 and C 2 {F) = n. 

Let X{n) denote the closure of I{n) within Ai(n). Our goal is to approach 
the understanding of the boundary dl(n) := T{n) \ T{n) of this compactification. 
Partial results in this direction are already known; in particular, it is clear that 
dl{n) has, in general, several irreducible components. These components have 
been completely determined only for charges C 2 = 1 [I] and C 2 = 2 [14]. The case 
C 2 = 3 was partially treated in [3 da Hi- Perrin in m Remarque 3.6.8] cites a 
conjecture of Gruson and Trautmann, suggesting that the boundary of 1(3) consists 
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of 8 irreducible divisors. He also advances towards a proof of this conjecture by 
constructing two out of the eight conjectural boundary divisors, in addition to the 
three ones constructed before. 

All the boundary components for charges C 2 < 3, known or conjectural, are 
divisorial and consist of non locally free sheaves. A new phenomenon occurs for C 2 = 
5: in [18], Rao shows the existence of a divisorial component of dl{5) whose generic 
point represents a vector bundle, for which the vanishing condition h^{E{—2)) = 0 
fails. 

In the present paper we describe n irreducible components of dllri), whose 
generic points represent instanton sheaves. By definition, these are rank 2 torsion 
free sheaves E on satisfying (P), ([2|), but also the additional vanishing conditions 
hf{E{—2)) = h^{E{—3)) = 0, which, by Serre duality, are automatically satisfied 
when E is locally free. Thus, for example, Rao’s component of dX{5) does not satisfy 
these vanishing conditions and is not of the type we are interested in. Also one can 
see that among the eight Gruson-Trautmann (partly conjectural) components of 
91(3), only four parametrize instanton sheaves in our terminology. One can say 
that the instanton sheaves provide a partial compactification of X(n), and we study 
the boundary of this partial compactification. 

Our main result is that for any n > 1, dl(n) contains n irreducible divisors 
'D(m,n), where m = l,...,n, of I{n), whose generic points represent instanton 
sheaves and are smooth points of M{n). A sheaf in 'D{m, n), generically, is singular 
along a normal rational curve of degree m. By m, the singular locus of any 
instanton sheaf, if nonempty, is a scheme of pure dimension 1. An important 
invariant of a non locally free instanton sheaf E is Qe '■= E''''/E, which is a pure 
1-dimensional sheaf supported on the singular locus of E. A necessary condition for 
a pure 1-dimensional sheaf Q to be Qe for some E £ dl{n) was determined in |171 
Thm. 0.1]: Q{—2) should be a theta-characteristic of its supporting 1-dimensional 
scheme. 

Our boundary components 'D{ni, n) coincide with some of the components con¬ 
sidered in P (case n = 1), [14] (case n = 2) and [TS] [161 IE] (case n = 3). For 
n > 3, the components here presented are new. However, our components are 
not sufficient to exhaust the boundary of the partial compactification by instanton 
sheaves, for one of the components of dX{3) presented in [16] is associated to theta 
characteristics of plane cubic curves in We still do not know which pure 1- 
dimensional sheaves do occur as singular locus of non locally free instanton sheaves 
in the boundary of X{n). Nonetheless, we expect that our examples, associated to 
theta characteristics of smooth rational curves, are singled out by that they are 
smooth points of A4(n). We provide an evidence to support this expectation by 
proving that the instanton sheaves which are singular along elliptic curves of degree 
< 4, form a separate component of A4{n). 

Now we will briefly describe the content of the paper by sections. In Section 2, 
we introduce instanton sheaves and provide some relevant properties. In Section 3, 
we prove basic properties of the main tool for constructing non locally free instanton 
sheaves: elementary transformations along a curve in endowed with a line bundle 
Q satisfying h°{Q{—2)) = h^{Q{—2)) = 0. In Section 4 we prove the stability of the 
sheaves obtained by elementary transformations from instanton bundles. Section 
5 contains calculations with local and global exts involving a sheaf E, obtained 
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by an elementary transformation, with a view towards computing the infinitesimal 
deformation and obstruction spaces Ext*(J^, F) {i = 1, 2). 

In Section 6 we construct the irreducible (8n — 4)-dimensional irreducible subva¬ 
rieties of A4(n) and their open subsets V{m,n), parametrizing instanton 

sheaves F obtained by elementary transformations of instanton bundles of charge 
n along rational normal curves of degree m (Proposition [6]4]) . We also prove that 
for an instanton sheaf F from 'D(m,n), we have dimExt^(F, F) = 8n — 3 and 
Ext^(F, F) = 0, so that M.(n) is smooth of local dimension 8n — 3 at F (Proposi¬ 
tion I6.5p . 

In Section 7, we prove the main result of the paper, stating that F(to, n) are 
divisors lying in the boundary dX(n) of the instantons of charge n for each m = 
1,..., n fTheorem 17.81) . This is done by induction on m and n, using deformations 
of elementary transforms of several types along 1-dimensional sheaves with supports 
on reducible rational curves. 

In Section 8, we show that the elementary transformations of null-correlation 
instanton bundles along elliptic quartic curves provide a generically smooth irre¬ 
ducible component of Ad (5) of dimension 37, equal to the dimension of F(5) (The¬ 
orem 18.21) . We also remark that somewhat easier arguments prove the following 
similar result: the elementary transforms of 0®3 along plane cubic curves fill an 
irreducible component of M(3) of dimension 21, equal to the dimension of F(3). 
This property implies, in particular, that the boundary divisor of F(3) described 
by Perrin in m, associated to plane cubic curves, is a non normal singularity of 
Ad (3), given by the intersection of this new irreducible component with F(3). 

Throughout the paper, the base field will be the field of complex numbers C. We 
work in the algebraic setting, so the term “variety” means “reduced scheme of finite 
type over C”. We will use interchangeably the terms “vector bundle” and “locally 
free sheaf’. The projectivization P(P) of a vector space V will be understood as 
the variety of lines in V, and the projectivization P(F) of a vector bundle F over 
a variety X as the relative proj-scheme Pioix {Sy'm,{E'^)^. 

Acknowledgements. MJ is partially supported by the CNPq grant number 
302477/2010-1 and the FAPESP grant number 2014/14743-8. MJ aknowledges the 
hospitality of the University of Lille 1. DM acknowledges the FAPESP grant num¬ 
ber 2011/06464-3, which allowed him to visit the University of Campinas. DM was 
also partially supported by Labex CEMPI (ANR-ll-LABX-0007-01). DM and AT 
acknowledge the hospitality of the Max-Planck-Institut fur Mathematik in Bonn, 
where they made a part of work on the paper. 


2. Monads and instanton sheaves 

In this section we set up notation and revise important results from the vast 
literature on instanton sheaves on P^. We also establish a couple of new propositions 
that will be relevant for the main results of the present paper. We work over the 
field of complex numbers; all sheaves of modules are coherent. 

Recall that a monad on a projective variety A is a complex of locally free sheaves 
of the form 


( 3 ) 


a^bAc 
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where a is injective and P is surjective. The sheaf ker^/ima is called the coho¬ 
mology of ([3]). li A = C>x(—1)®“, B — and C = then ([3]) is a called 

linear monad. 

An instanton sheaf on is a torsion free sheaf F with trivial determinant and 
satisfying the following cohomological conditions 

H°{F{-1)) = H\F{-2)) = H^{F{-2)) = H^{F{-3)) = 0. 

The integer n := —x(F(—1)) is called the charge of F; it is easy to check that 
n = h^{F{—l)) = C 2 {F). The trivial sheaf Off of rank r is considered as an 
instanton sheaf of charge zero. 

Using the Beilinson spectral sequence, one can show that the instanton sheaves 
are precisely those that arise as cohomologies of linear monads of the form 

H^F (g) ^ 23 ( 1 )) (g) C)p3(-1) ^ (g Uj. 3 ) g Op3 H^{F{-1)) g C>p3(l), 

see for instance IS Proposition 14]. One checks that h^(Fgr2p3(l)) = 1)) = 

n and h^ (F g r2p3) = 2n + r, where r denotes the rank of F. The above monad can 
therefore be written in the following simpler way: 

(4) M* : Op3(-l)®” 4 0 ®^”+’'Ac>p3(1)®” 

The following result will be relevant in what follows. 

Lemma 2.1. If F is an instanton sheaf on P^, then 

(i) £xtPiF,F) = 0 forp>2; 

(ii) £xtP{F, Ops) = 0 for p > 2; 

(hi) Ext^(F,F) = 0. 

Proof. Since F can be realized as the cohomology of a monad of the form (|3]), we 
have a short exact sequence 

0 ^ C>p3(-1)®‘= 4 X ^ F ^ 0, 

where K := ker /3 is a locally free sheaf. Applying the functor 'Hom{—, F) we obtain 
£xtP-\Opn{-l)®<^,F) £xtP{F,F) £xtP{K,F). 

Since Ops)—1) and K are locally free sheaves, the first and the third sheaves in the 
previous sequence vanish for p >2, and the first item follows. 

The second and the third items are proved in a similar way; compare with nni 
Corollary 7]. □ 

Recall that the singular locus Sing(G) of a coherent sheaf G on a nonsingular 
projective variety X is given by 

Sing(G) •.= {x & X \ Gx is not free over Ox,x}, 

where Gx denotes the stalk of G at a point x and Ox,x is its local ring. 

It is not difficult to see that the singular locus of a non locally free instanton 
sheaf F on P^ is precisely the set 

Sing(F) := {a: € P^ | a{x) is not injective}, 

where a(x) denotes the map of fibers over the point x S P^. 

Now we focus on rank 2 instanton sheaves, which are the main object of study 
in this paper. The following result is proved in m Main Theorem]. 

Theorem 2.2. If F is a non locally free instanton sheaf of rank 2 on P^, then 
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(i) its singular locus has pure dimension 1; 

(ii) F'''^ is a (possibly trivial) locally free instanton sheaf. 

In particular, every relfexive instanton sheaf of rank 2 is actually locally free, as 
it can also be deduced from [SI Proposition 2.6]. We remark that both claims are 
false for instanton sheaves of rank at least 3, see m for precise examples. 

Lemma 2.3. Every nontrivial instanton sheaf F of rank 2 on is simple and 
F[^{F) = 0. If F is locally free, then it is p-stable. If F is torsion free, then it is 
fi-semistable. 

We will see below in Lemma l4 .1 1 that there are non locally free rank 2 instanton 
sheaves that are not /r-stable, though certain non locally free rank 2 instanton 
sheaves are /r-stable, see Lemma Td. II below. 

Proof. The simplicity claim is [101 Lemma 23]; the vanishing of /i°(F) is [TOl Propo¬ 
sition 11]. If F is locally free, the vanishing of h^{F) is sufficient to guarantee the 
/r-stability. From the sequence 

0^ F ^ F'''' ^ F''''/F 0 

we see that if F is not /r-semistable, then neither is F'^'', which is a contradiction. 

□ 


3. Elementary transformations of instantons 

Let E be a reduced locally complete intersection curve of arithmetic genus g. By 
the degree of a line bundle L on E we understand the integer deg(L) = x{L) + g — l. 
For fc G Z set Pic^(E) := {[L] G Pic(E)| deg(L) = fc}. 

Let E be an instanton sheaf (possibly trivial); elementary transformation data 
(E, L, (fi) for E consist of the following: 

(i) an embedding t : E ^ P^ of degree d; 

(ii) a line bundle L G Pic®“^(E) such that hP{L.fL) = h^{L.fL) = 0; 

(iii) a surjective morphism ip : E ^ (i*L)(2). 

Proposition 3.1. Given an instanton sheaf E of rank r and charge n, and ele¬ 
mentary transformation data (T,,L,ip) for E as above, the sheaf F := Veup is an 
instanton .sheaf of rank r and charge n-\-d. Moreover, F'^ ~ E'^ and, if E is locally 
free, then F''''/F cs (t*L)(2). 

The sheaf F kert^ is called an elementary transform of E along E. A similar 
construction was proposed by Maruyama and Trautmann in [131 Definition 1.7] for 
the case when E is a union of hnitely many disjoint lines. 

Proof. First, applying Riemann-Roch for the immersion t : E ^ P^, we have 

(5) ch((i*L)(2)) = i* (ch(L( 2d pt)) • td(A^x:/p3)~^) > 

where L G Pic®“^(E) and N-^/p3 is the normal bundle, related to the tangent 
bundles Tg and Tps to E and P^ respectively by the exact triple 

(6) 0 —y Tj] —^ FTp3 —y A^5]y'p3 —y 0. 

It follows from ([Hj) that ci(As/p3) = 4d-|- 2g — 2. Plugging this back into ([5|), we 
get 

ch3(((.»L)(2)) = ci(L( 2d pt)) — ci{N)/2 = g — 1 -\-2d— ^(4d + 2g — 2) = 0. 
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Now consider the short exact sequence 


(7) 


0 F 


E 


(t*L)(2) ^ 0. 


Since chi((6*L)(2)) = ch3((t*L)(2)) = 0, we obtain ci(F) = C 3 (F) = 0; since also 
ch2((t*F)(2)) = [S], we conclude that C 2 (F) = C 2 {E) + d = n + d. 

Next, twisting © by Ops {—2) and passing to cohomology, we see that 
h}{E{—2)) = h‘^{E{—2)) = 0, since by hypothesis hP{L^L) = 0 for p = 0,1. 

It is also easy to check that h°(F(—1)) = h^{E{—3)) — 0 forces 1)) = 

h^(F(—3)) = 0, since E is a curve. It then follows that F is an instanton sheaf of 
rank r and charge n + d. 

Finally, note that f 2:t^((r*L)(2), Ops) = 0 because the sheaf (t*L)(2) is supported 
in dimension 1. Therefore, dualizing the sequence 0, we obtain the isomorphism 

_ £1V_ 

For the last claim, consider the diagram 


0 0 


0-^ F -^ E -^ (6*L)(2)-^ 0 

pvv - pvv 




0 


This diagram and the Snake Lemma yield the desired isomorphism F''''/F ~ 

(t*L)(2). □ 


Note that two elementary transforms F and F' of the same instanton sheaf 
E given by elementary transformation data (T,,L,ip) and respectively 

are isomorphic if and only if there is an isomorphism ip : l^L —>■ d^L' such that 
Ip o if = ip’. 

Consider now the case when E = Ei U E 2 , where Ei and E 2 are reduced, lo¬ 
cally complete intersection curves such that Ei U E 2 is again a locally complete 
intersection curve. Take an instanton sheaf E and elementary transformation data 
(El, Li, (pi) for E] let Fi be the elementary transform of E along these data. Then 
take some elementary transformation data (E 2 ,L 2 ,<P 2 ) for Fi, and let F 2 be the 
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corresponding elementary transform. We obtain the diagram 

0 


0-^ Fa- E -^ Q -s- 0 

I 

i ^ I 

'' Y 

(8) 0-^Fi- ^^ E -^0 

(t2*F2)(2) 


0 

Thus Fa is an elementary transform of F along a torsion sheaf Q fitting into the 
short exact sequence 

0 —>■ (t2*F2)(2) —>■ Q —^ (ii,Fi)(2) —>■ 0. 

Note that if Si and Ea do not intersect, then Q = ((,i*Fi)(2) © (i2*F2)(2). We will 
say that Fa is obtained from F by a concatenation of the elementary transformations 
with elementary transformation data (Ei, Fi, ifi), (Ea, F 2 , ^’ 2 )- 

Remark 3.2. More generally, fix an instanton sheaf F of rank r and charge n, and 
let Quot‘^^^'''^^(F) denote the Quot scheme of quotients ip ■. E ^ Q with Hilbert 
polynomial Pgik) = d{k + 2). 

Take (Q,p) S Quot‘^^^^‘^(F) satisfying hP{Q{—2)) = h^{Q{—2)) = 0. Then one 
can show that the sheaf F := ker p is an instanton sheaf of rank r and charge n-\-d. 
We say that F is a transform of E along Q. 

In this case, one has the short exact sequence 

O^F —>E ^Q^O. 

Since F is an instanton sheaf and Q is supported in dimension 1, we have 
h°(F(—1)) = h^(F(—3)) = 0. Moreover, the vanishing of h^{Q(—2)) and 
h^((3(—2)) = 0 implies that h^(F(—2)) = hf{F{—2)) = 0, hence F is a linear 
sheaf. The Hilbert polynomial of F is given by 

Pp(k) = Ppik) — idk + 2d) = ^k^ + rk^ + {— (n + d) ) k + (r — 2(n + d )), 

6 \ 6 / 

so that ci(F) = 0 and C 2 (F) = n + d. 

4. Stability of transforms 

In this section we will prove several facts regarding the stability and /r-stability of 
non locally free instanton sheaves, obtained as transforms of locally free instantons 
in the way described in Remark 13.21 

Lemma 4.1. If E is a p-(semi)stable instanton sheaf, then every transform of E is 
also fj,-(semi)stable. Moreover, every transform of the trivial sheaf is p-semistable 
but not fi-stable. 
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Proof. If F is a transform of a /x-(semi)stable instanton sheaf E which is not /i- 
(semi)stable, then it admits a subsheaf G with ^(G) > 0 (^(G) > 0). It follows 
that G would also destabilize E. 

It follows in particular that every transform F of the trivial sheaf is /i-semistable; 
to see that it is not ^-stable, just note that E[^{F'') = E[^{Opf) 0. □ 

As is well known, every nontrivial locally free instanton sheaf of rank 2 is 
stable. This implies: 

Corollary 4.2. Every transform of a nontrivial locally free instanton sheaf of rank 
2 is fj,-stable, and hence stable. 

Now we will focus on the case of rank 2. We will see that certain transforms of 
the trivial rank 2 sheaf are also stable. 

In what follows, we denote by prik) the reduced Hilbert polynomial of a sheaf 
F on P^. 

Lemma 4.3. Every elementary transform of the trivial sheaf of rank 2 along an 
irreducible curve is stable. 

Proof. Let F be defined by the short exact sequence 

0 ^ F ^ G ®2 ^ g ^ 0 

for some elementary transformation data (EjLjip) with irreducible E, where Q = 
(i*F)(2) and i : S ^ P^ is the natural embedding. It is enough to consider 
torsion free sheaves G C F of rank I whose quotient T := F/G is also torsion free. 
Moreover, since F is /r-semistable, we can take deg(G) = 0, thus G is the ideal 
sheaf I A of a subscheme A C P^ of dimension at most 1. 

We thus obtain the diagram 

0 0 


I A -^ Op3 -^ %a*Oa -^ 0 

I 

IC 

Y 

F-^ G®"-^ Q -^ 0 


T Op3 


0 0 

where za : A P^ is the natural embedding. It provides a map C : Ga Q and 
an exact sequence 

0 ker (j —>• T Gpa —>• coker ^ > 0. 

Since T is torsion free, it follows that kerC = 0 and Ga is a subsheaf of Q. Since E 
is irreducible, we must then have that either A = E, and hence G = /s, or A = 0, 
and hence G = Gps. 


0 

(9) 0 
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Since H°{F) = 0 by Lemma [231 the second case does not occur. In the first 
case we have, 



where d := deg(E) = C 2 {F). Hence F is stable. 


□ 


Remark 4.4. Note that we do not use the hypothesis h^{Q{—2)) = h^{Q{—2)) = 0 
in the proof above. In other words, if Q is sheaf with Hilbert polynomial Pqik) = 
dk + 2d and irreducible support, then the kernel of a surjective morphism 0*3^ ^ Q 
is a stable rank 2 torsion free sheaf F with ci(J^) = C 3 {F) = 0 and C 2 {F) = d. 

As a by-product of the previous proof we also obtain the following interesting 
fact. 

Corollary 4.5. Every elementary transform of along an irreducible curve S 
of genus g and degree d is an extension of an ideal sheaf Iz of a 0-dimensional 
subscheme Z C of length 2d -\- g — 1 by the ideal sheaf Iz, ■ 

We now consider another situation, given by a concatenation of two elementary 
transformations along irreducible rational curves, that will be relevant later on. 

Let j ^ P^ be a line and let j : L ^ P^ be a rational curve of degree m — 1 
(m > 2); assume that either £ n L = 0, or £, T intersect quasi-transversely at a 
single point P; we say that the intersection is quasi-transverse when the tangents 
to r,£ at the intersection point are distinct. Consider the sheaf Q given by an 
extension 


(10) 0 ^ (z,0,(-pt))(2) ^ Q ^ (j,Or(-pt))(2) ^ 0. 

Such an extension may be nontrivial only if L, £ intersect. So, either 
Q ~ (i*C)f(pt)) © (j*C>r((2TO - l)pt)), 
or the curve L U £ is connected and Q is a line bundle on L U £ such that 

~ C>f(2pt), Qlr cs C’^((2m - l)pt). 


Let E be an instanton sheaf of rank r and charge c, and assume there exists a 
surjective map ip : E ^ Q. Let F := ker(^. We have the following diagram: 


0 


'' 


(j*0^(-pt))(2) 


' ’ 


( 11 ) 


0 


F 


E 


Q 


0 


T 


0-^ F' -^ E (j,C)r(-pt))(2)-^ 0 


0 


where F' := 


kerr o (p. We then obtain the short exact sequence 
O^F^ F' ^ (i*C>f(-pt))(2) ^ 0. 


( 12 ) 
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Comparing with diagram ([8]), we see that F is obtained by concatenation of two 
elementary transformations, first along F then along £. 

Lemma 4.6. Every transform of the trivial sheaf of rank 2 along a sheaf Q given 
by an extension m is stable. 

Proof. Let F be defined by the exact triple 

0 —y F —y —y Q —0. 

As observed above, F also fits into the short exact sequence (HU, where F' is an 
elementary transform of the trivial sheaf of rank 2 along F. 

Proceeding as in the beginning of the proof of Lemma 14.31 we conclude that any 
rank 1 torsion free subsheaf G C F with torsion free quotient T := F/G and zero 
degree is the ideal sheaf I a of a closed subscheme A C of dimension at most 1, 
and that Oa is a subsheaf of Q. There are only four possibilities for A: 0, £, F 
and F U £; then, respectively, G = Ops, G = h, G = It, and G = /ruf- 

The first possibility does not occur, since H^{F) = 0. Let us examine the other 
three possibilities. 

In the case G = Ii, we have G C F C F' and 

PF' {k) - pii (fc) = 2 ™^ ^ + 2 - TO. 

If TO > 3, we get pF'{k) — Pit{k) < 0, so G destabilizes F', which is impossible 
by Lemma 14.31 Assume now that G = Ig and to = 2. Then £, F are two lines 
spanning a plane, and If, does not destabilize F', but PF{k) — pi^{k) = —1 and so 
If destabilizes F. Let us see that this case is impossible. 

Consider the diagram (|9l) for our sheaf F with A = £. Arguing as in the proof 
of Lemma 14.31 we can complete it to the diagram 

0 0 0 


0 -S- If -S- Op3 -S- L^:Ol -S- 0 

c 

(13) 0-^ F -^ ^ Q -^ 0 


0-^ T-^ Op3-^ coker C, -9- 0 


0 0 0 

If, for instance, F, £ intersect and the extension (US is non-trivial, then ~ 
and Q|r — (j*Gr)(l)- As f factors through Q|^(—pt) ^ Q, 

cokerC ^ (j*Gr){l) © Cp/, 

where Cp' denotes a sky-scraper sheaf of length I supported at a point P' G £. It is 
obvious that coker cannot be generated by a single section, so that the surjection 
Op3 —>■ coker C in the last line of (na) does not exist. By a completely similar 
argument, one treats the remaining cases: (a) F, ^ intersect, but the extension (fTOll 
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is trivial, and (b) F, I do not intersect. The conclusion is that G = h ioi m = 2 
cannot occur as a destabilizing subsheaf. 

Next, the ideal sheaf It does not destabilize F when m > 3, for 


_ 2 

PF{k) -Pirik) = —-—k + 1 - m > 0, 

and it does not destabilize F for m = 2 by an analysis of a commutative diagram, 
similar to (IT^ (see also Remark Wl\ belowl. 

Finally, we check that the ideal sheaf IttH also does not destabilize F when 
TO > 2; indeed: 

TTi 

PE{k) - Plrutik^) = yfc+ (2 - to) > 0. 

□ 


Remark 4.7. Observe that we can permute the roles of £, F in the construction 
of the concatenation. In the same notation as in the paragraph preceding equation 
m, let Q be given by a nontrivial extension 

0 ^ (j,Or(-pt))(2) ^ Q ^ (*,0^(-pt))(2) ^ 0, 

and let F be the rank 2 instanton sheaf obtained by an elementary transformation 
of the trivial sheaf of rank 2 along Q: 

0 ^ F ^ ^ Q ^ 0. 

We then have the following two exact triples: 

0-^F^F' ^ (j,Or(-pt))(2) ^0 and 0 ^ F' ^ 0. 

Note that F' is stable by Lemma lT^ and the stability of F is proved by an argument 
similar to that of Lemma 14.61 

For example, the ideal sheaf Ii would destabilize F for some to > 2, if one 
might find an embedding Ii ^ F with torsion free quotient T = F/I^. Let us 
assume that such an embedding exists. Then we can complete it to a diagram of 
the form (IT^ . We observe that Q\i ~ ((.»Of)(l) and Qlr — j*Or((2TO — 2)pt), 
hence coker^ cs j*Or((2TO — 2)pt) cannot be generated by a single section, and the 
diagram (fT^ does not exist by the same reason as in the proof of Lemma 14.61 


5. HOM’S AND EXT’S of ELEMENTARY TRANSFORMS 
We start by the following general claim. 

Lemma 5.1. Let t : E ^ 6e a reduced locally complete intresection curve, 
M an invertible Oy.- sheaf, and E a rank 2 locally free sheaf on equipped with 
a surjective map ip : E ^ i^M. For the torsion free sheaf F := ker:^, we have 
nom{E,E)/'Hom{F,F) ~ (g) det(F)'^. 

Proof. First, apply 'Hom{—,E) to the short exact sequence 

(14) 0^ F^ E^ l^M 0. 

Since is a torsion sheaf supported on a curve and E is locally free, we have 
'Hom{i^:M, E) = £xt^{Lt:M,E) = 0, and conclude that 'Hom{E, E) ~ 'Hom{F,E). 

Next, applying 'Hom{L^:M,—) to the sequence (|T4ll and again using the van¬ 
ishing of 'Hom{it.M,E) and £xt^{i^.M,E), we obtain that £xt^{i^.M,F) ~ 

'Hom{uM, 6*M) = uOy- 
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Now, the diagram 

0 

0-^ 'Hom{E, F) -^ 'Hom(E, E) -^ 'Hom{E, i^,M) -s- 0 

(15) 0-5- 'Hom{F, F) — 'Hom{E, E) -^ coker r-^ 0 

i*OY, 


0 

is obtained in the following way. The first row comes from applying TLom^E, —) to 
the sequence (HI- The second row comes from applying 'Hom{F, —) to the same 
sequence, and using the identification T-Lom^E, E) ~ Hom^F, E). The left column 
comes from applying 'Hom{—,F) to (ITTl) . noting that Sxt^{L^:M,F) ~ and 

E) = 0. 

Now the Snake Lemma provides us with the short exact sequence 
0 —>■ E'' 0 Lt:M cokerr —>■ 0, 

since 'H.om{E^L^:M) ~ E'' 0 Since E has rank 2, it easily follows that 

'Hom{E,E)/'Hom{F,F) = cokerr ~ 0 det(iil)'', as desired. □ 

Next, we apply the previous Lemma to the case of elementary transformations 
of locally free instanton sheaves. 

Lemma 5.2. Let E be a rank 2 locally free instanton sheaf of charge n, and let 
{'E,L,ip) be elementary transformation data for E. If L is an invertible Os-sheaf 
satisfying /i^((t*L^)(4)) = 0, then for the sheaf F =: 'kerip, we have 

(i) Ext^(F,F) = H°{£xt^iF,F))(SH\nom{F,F)); 

(ii) Ex^t^{F,F) = H\£xt^iF,F)) ^ H\Sxt'^iii^L){2),F)); 

Furthermore, one has 

(16) h\nom{F, F)) =8n + /i°((t*L^)(4)) - 3 

Proof. We use the local-to-global spectral sequence for Ext’s, whose E 2 term is of 
the form 

= HP{£xt\F,F)). 

First, from Lemma (Eiri )) we know that £xt'^{F, F) = 0 for q = 2,3, killing the 
terms E^'^ for q = 2,3. Moreover, since £xt^{F, F) is suported on E, it follows that 
for p = 2,3. 

Applying Lemma FS.II to the sequence 

0 ^ F(-2) ^ F(-2) ^ 0, 

we obtain the short exact sequence 

(17) 0 ^ Hom(F, F) ^ nom{E, E) 0. 
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Since is supported in dimension 1, passing to cohomology, we conclude that 
H^{'Hom{F,F)) cs Ext^{E, E) = 0 by (12.11 iiiill: thus E^^ also vanishes. 

Finally, sequence (HB and the hypothesis /i^((i*L^)(4)) = 0 imply that 
H^('Hom{F, F)) ~ H‘^{'Hom{E, E)). The last cohomology vanishes by hypothe¬ 
sis, thus also = 0. 

It then follows that the spectral sequence already degenerates at the second page, 
and one concludes that: 

Ext\F,F) = H°{£xt\E,E))®H\'Hom{E,E)) and Ext^(F,F) ^ H\£xt\E, E)), 

as desired. The isomorphism F[^{£xt^{F, F)) ~ F['^{£xt^{{i^L){2),F)) is obtained 
from applying the functor 'Hom{—,F) to the sequence ([T]). 

In order to establish formula (ITS)) , consider the cohomology exact sequence as¬ 
sociated to the exact triple of sheaves (HB: 

0 ^ H°{nom{F,F)) H^{nom{E,E)) 

H^{'Hom{F,F)) H^{nom{E, E)) 0. 

Since every nontrivial rank 2 instanton sheaf is simple, we have 
h'^{'Hom{F, F)) = 1. Then, counting dimensions in the sequence above, we 
have 

h^('Hom{F, F)) = h^{'Hom{E, E)) + /i°((t*L^)(4)) + 1 — hP{'Hom{E, E)). 

There are now two cases to consider. First, if E is a nontrivial rank 2 locally 
free instanton of charge n, it follows that Ext^(E,E) = 0 (see [H]). Moreover, 
hP{'Hom{E, E)) = I, since E is simple. Therefore, h^{'Hom{E,E)) = 8n —3, hence 
the desired formula follows. 

On the other hand, if E = 0*3^ (i.e. if n = 0), then h^{'Hom(E, E)) = 4 and 
h}{'Hom{E,E)) = 0, hence one also obtains formula (TTSl) . □ 

Lemma (5.21 prompts us to characterize the sheaf £xt^{F,F) when F is an ele¬ 
mentary transform of a rank 2 locally free instanton sheaf. Applying the functor 
'Hom{F, —) to sequence ([7]) we obtain 

(18) 0nomiF, F) ^nomiF,E) ^ Hom(F, ((,*L)(2)) ^ 

£xt\F,F) ^£xt\F,E) £xt^{F,{i^L)(2)) ^ 0, 

since £xt^(F, F) = 0 by Lemma l2.ll Invoking now Lemma lS.ll and the isomorphism 
TLom{F,E) ~ 'Hom{E, E) (see the first paragraph of the proof of Lemma ISTl) 
sequence (HI can be rewritten in the following way: 

(19) 0 ^ (6*L^)(4) ^ Hom{E, (t*L)(2)) ^ £xt^{F, F) 

£xt\F, Ops) (g) F ^ £xt\F, (t*L)(2)) 0. 

In the next section, we will carefully analyze each term of this exact sequence 
for elementary transforms along rational curves. 

6 . Definition and properties of V{m,n) 

Let TZo{m) denote the space of nonsingular rational curves of degree m on P^. It 
is well-known (see e. g. m) that TZoi'iTT') is a nonsingular irreducible quasiprojective 
variety of dimension 4m and that the set 

TZ*o{m) := {F G 7^o(m) | iVr/pa ~ Or((2m - l)pt)®2}. 
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where pt denotes a point of F, is a dense open subset of TZo{m) for m > 1, m ^ 2. 
Besides, it is obvious that iVr/pa ~ Or(2pt) © Or(4pt) for every F e 7?.o(2). We set 
7^S(2) :=7^o(2). 

Lemma 6.1. Let E be an instanton sheaf. Then for any m > I, the restriction of 
E to a generic rational curve of degree m in is trivial. 

Proof. For m = 1, the assertion follows from the /x-semistability of E and the 
Grauert-Miillich Theorem [9l Theorem 3.1.2]. For m > 1, we start by restriction to 
a generic chain of m lines and then smooth out the chain of lines to a nonsingular 
rational curve of degree m. 

By a chain of lines we mean a curve Fq = U ... U in such that £i,..., 
are distinct lines and (.i n £j ^0 if and only if |x — j| < 1. It is well known (see 
e. g. [U Corollary 1.2]) that a chain of lines Fq = U ... U £m in P^ considered 
as a reducible curve of degree m can be deformed in a flat family with a smooth 
one-dimensional base (A,0) to a nonsingular rational curve F € TZoijn). Making 
an etale base change, we can obtain such a smoothing with a cross-section. 

By the case m = 1, the restriction of i? to a generic line is trivial. By induction 
on m, we easily deduce that for a generic chain of lines Fq, the restriction of E 
to Fq is also trivial: Fl]ro — which is equivalent to saying that E\i. ~ Of^ 

for all i = 1,...,TO. Choosing a smoothing {FtjtgA of Fq with a cross-section 
t !->■ Tt G Ft as above, we remark that Flirt — C>rt(fctpt) © Ort{—kt]t) for some 
integer kt which may depend on t. The triviality of E\y^ is thus equivalent to the 
vanishing of F°(Fl|rt(—pt)). Using the semi-continuity of F°(£’|rt(—ict)), we see 
that £l|rt is trivial for generic t G A. □ 

Lemma 6.2. Let 1 < m < n, and let E be an instanton sheaf of charge n. Then 
K{m)E := { F G 7^S(m) | E\r ~ Of } 
is a nonempty open subset oflZgim). Moreover, 

B{m,n) -.= { ([£;],F) G X(n - m) x 7^S(r7^) | F G n*o{m)E } 

is a nonempty open subset of I{n — m) x TT^{m), whose projections to both factors 
are surjective. 

Proof. To prove the first assertion, note that TT!^(m)E is nonempty by Lemma lOI 
It thus suffices to show that any F G T^q e bas a Zariski open neighborhood in 
entirely contained in 72.Q(m)r;. 

For any F G Tif,{m)E, we can find a plane FI P^ in P^ meeting F transversely 
in m distinct points. Then the set U = C/(n) C TZ^i^m) of curves F' G 7^q(to) that 
meet FI transversely in m points is a Zariski neighborhood of F as a point of TZq (m). 
Define 

u = U{n) := { (cc, F) G n X t/ I a: G F }. 

Let r C P^ X TZq (m) be the universal degree-m rational curve over TZq {m ), and for 
any morphism T -G TZ^ljn), denote by Fr the pullback T Xn*{m)B C P^xTofF via 
this morphism. For t G T, we will denote by Ft the fiber of F^ over t. The natural 
map IJ ^ [/ is an etale covering of degree m, and the pullback F^ —>• U admits 
m disjoint cross-sections Xi : tj ^ F^ (i = I,... ,m) with images in 11 x I/. For 
u G U, the triviality of i?|rij is equivalent to the vanishing h^{E\Y.,^{—Xi{u))) = 0, 
so, by the semi-continuity of /i°, the subset V C U oi points u G U such that Elr^^ 
is trivial is open in U. By the openness of finite etale morphisms, the image V of 
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y in t/ is open. This is an open neighborhood of T contained in TZ^{m)E^ so the 
first assertion is proved. 

The second assertion is obtained by relativizing the above argument over 
X[n — m). This is straightforward when X{n — m) possesses a universal instan- 
ton bundle. By IS Section 4.6], this happens when n — m is odd. Moreover, the 
assertion is trivial for n — m = 0, in which case the only instanton bundle is 0 * 3 ^. 
In the case of even n — m > 2, the argument extends verbatim by replacing “uni¬ 
versal” by “quasi-universal”. A quasi-universal sheaf E of multiplicity u > 1 is a 
sheaf over x A4^*(n — m) such that £l|p3x{t} — E®'' for every t G M^^{n — m), 
where M^^{n — m) is the locus of stable sheaves in M{n — m), and Et denotes a 
stable sheaf whose isomorphism class is represented by t. By loc. cit., there exists 
a quasi-universal sheaf of multiplicity iz = 1 if n — m is odd (and then it is indeed 
universal) and u = 2 if n — to is even. 

Taking a pair (t, T) G B{m, n), we choose a plane 11 in meeting T transversely 
and define U, U as above, and consider the relative degree-TO rational curve T := 
X{n — m) X Fy with a natural projection tt : T —>■ X(n — to) x U. Then the set 


V = 


|(t,u) G X(n -m) xU h° (^Er\n-m,u){-xi{u))'^ = o| 


is open by Grauert’s semicontinutity. Hence its image V under the etale map 
X{n — m) X U ^ X{n — to) x TZ'^{m) is an open neighborhood of (t,r), and the 
openness of B{m,n) is proved. 

□ 


Corollary 6.3. B{m,n) is a nonsingular irreducible quasiprojective variety of di¬ 
mension 8n — 4 to — 3. 

For (t,r) G B{m,n), let L be the line bundle C>r(—pt) of degree —1 on T. 
Denoting by t the natural embedding T ^ P^, we have /i°(t*L) = /i^(t*L) = 0 and 

Hom(At, (i*L)(2)) ~ Hom(0®^ C>r((2TO - l)pt)) ~ H°{Or{{2m - l)pt))®2. 

We thus conclude that there exists a surjective map ip : Et ^ (i*L)(2), so that 
(r, L, ip) is a set of elementary transformation data for Et- 

By Proposition 13.11 Corollary 14.21 and Lemma [4.31 F := kertp is a stable rank 
2 instanton sheaf of charge n, whose double dual is isomorphic to Et- For n > 1 
and each to = l,...,n, consider the subset T>{m,n) of A4(n) consisting of the 
isomorphism classes [F] of the sheaves F obtained in this way: 

V{m,n) :={[F] e M{n) \ G I(n - to), F = Supp(F'^7F) G7^5(TO)i.vv , 

and F'^'^/F ~ (i*L)(2), where L = Or(—pt)}- 
Let V{m,n) denote the closure of V{m,n) in A4(n). 

Proposition 6.4. For n > 1 and 1 < m < n, T>{m,n) is an irreducible projective 
variety of dimension 8n — 4, and T>{m,n) is open in T>(m,n). 

Proof. We will construct a Severi-Brauer variety V = 'P{m,n), fibered over B = 
B{m,n) with fiber and an open subset Z C V together with a morphism 

Z A4(n) mapping Z bijectively onto X> = T>(m,n). 

According to Section 4.6], a universal rank-2 sheaf exists locally in the etale 
topology over the stable locus A4®* of A4 = A4(n — to). Thus there exists an open 
etale covering : IT —>■ A4®* and a rank 2 sheaf E = Ew over P^ x IT such that 
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for any w G W, Ejpsxu, — Bt, where t = $(w) G and Et denotes the stable 
sheaf whose isomorphism class is represented by t. Refining the etale covering, 
one can define “transition functions” g : pr *2 P^ia E over x W x^st W, 

where pr^ denotes the projection to the product of the i-th, ■ • factors of a 
product of several factors. The transition functions, in general, fail to satisfy the 
cocycle condition, so E does not descend to At®*. The failure of g to satisfy the 
1-cocycle condition is measured by a gerbe Cg G T{W W x^at W,0*), which 
is an etale 2-cocycle representing a i^-torsion element a = [cg] of the Brauer group 
Br(Af®*) C ,0*), where = 1 or 2 depending on the parity of n — to. 

Over X IE x^st W Xj^st W, the following twisted cocycle condition holds: 

( 20 ) prj '34 g o prj '23 g = pr234 Cg • prj '24 9- 

We now choose an etale open covering V ^ B hy the etale open sets V con¬ 
structed in the end of the proof of Lemma [6.21 and define U = W x^st V. We 
also denote by E the pullback of the universal degree-m rational curve in with 
two natural maps n : T ^ U , l : T ^ x U , and by E the pullback of E to E. 
Then if possesses to disjoint cross-sections over U, which we denote cci,..., Xm, as 
before, and we can choose a global line bundle L on E of relative degree —1 over 
U by setting L := Opt—xi). For an integer k, we denote by Or(k) the pullback of 
Op3{k), andL(fc) := L 0 Op(/fc). 

For any u G U, we have Er^ — and Hom(Eri,L(2)|r^;) — 

0®^((2to — l)pt)), where F^j := 7f“^(M), is a 4TO-dimensional vector space. 
These vector spaces glue into the vector bundle r := Horrif^^CE^, over U. 

Its associated projective bundle pfy : := Px —>• 17 descends to B, that is, 

there exists a Severi-Brauer variety : Pg ^ B with fibers p4™-i such that 
Pj^ ~ U XgPg. Indeed, as follows from (ISHll . the failure of the transition functions 
of Ejj and of r to form a 1-cocycle for the etale open covering U ^ B is only in a 
scalar factor Cg , so the transition functions modulo homotheties do form a 1 -cocycle 
and define a projective bundle over B. 

The open subset Zu in P~"*“^ := PHom(Er^,L(2)|r^;) consisting of propor¬ 
tionality classes [(j)] of surjective homomorphisms (p : Ep^ ^ L( 2 )|rfi is the 
complement to the zero locus An of the resultant 7?.(/o,/i) of the two com¬ 
ponents of (j), viewed as a pair of polynomials (/o,/i) on F^i ~ P^ of degree 
2m — 1, fi G H^(Tu,Or^{{2m — l)pt)). It is easy to see that Tl{fo,fi) de¬ 
pends on the choice of homogeneous coordinates on F^^ ~ P^ via the character 
GL 2 {C) —)• C*, A i-A (det and is multiplied by (det when the 

identification Ep^j — 0®'p’ is changed by means of a matrix B G GL 2 (C). This 
implies that the resultant TZ can be viewed as a section of a line bundle upon lifting 
to an appropriate GL 2 {C) x GL 2 (C)-torsor over P^y, and the zero locus of this 
section descends to a relative divisor Ag in Pg over B. 

We have thus shown that the surjectivity loci G1 glue into an open 

subset Zjj C Py which is the inverse image of the open subset Zb = Pg \ Ag 
of Pg. Now we are ready to construct a universal family F of the instanton sheaves 
of charge n over Z^. 

Remark, that (the equality sign meaning a canonical 

isomorphism), so that the canonical Casimir section cr G F(I7, t'' 0 t) comes from 
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a unique section cr G r(Pj^,p~r ® The latter defines a morphism of 

sheaves 4> '■ P^^*L(2), and we set F ker(/)| 2 j_. We have the following 

exact triple: 

4*\z— 

By construction, the classifying map Zfj M{n) of F factors through a bijection 
B 2?(to, n), and we are done. □ 


Now we will prove the smoothness of A4{n) along 'D{m,n). 


Proposition 6.5. Let [F] G 'D{m,n) with n > 1 and 1 < m < n, where [F] 
denotes, as before, the point of the moduli space representing the isomorphism class 
of a stable sheaf. Then dimExt^(F, F) = 8n — 3 and Ext^(F, F) = 0, i.e. [F] is a 
nonsingular point of M.(n). 


Proof. Recall that, if t : T ^ is a smooth rational curve of degree m belonging 
to R^lrn), then by definition 


( 21 ) 


f Or((2m — l)pt)®^ if m^2 
Or(2pt) © Or(4pt) if m = 2. 


Thus 


(22) det A^r/p3 — Or((4TO — 2)pt) for all m > 1. 

Moreover, 

(23) Sxt^^*Or) — L*Nr/p^ : fa;t^(6*Or, t^Or) — 6^, det iVpypa, 


(24) Txt^(i.^,Or,Op3) = 0 and fa:t^(t*(!lr, Ops) — i* det iVr/pa. 

We have the short exact sequence 

(25) 0 ^ FF^'^(t*F)(2) ^ 0, 

where L := Or(—pt) and F'^'' is a rank 2 locally free instanton sheaf of charge 
n — m. It follows that Ext^(F'''^, F'^'') = 0 (see [12]) and 

ili(p3,(6,F^)(4)) ~ifi(r,C)r((4m-2)pt)) =0, 

thus we can apply Lemma 15.21 

We start by computing h^{'Hom{F,F)). Since 

h°(p3, (6*F2)(4)) = h°(T, Or((4m - 2)pt)) = 4m - 1, 

we obtain from formula dSD that either 

(26) h^(fHom{F, F)) = 8n — 4m — 4, if n > m, 
i.e. if F'^'^ is nontrivial, or 

(27) /i^(Hom(F, F)) = 4m — 4, if n = m, 
i.e. if F'^'' is trivial. 

Next, we characterize the sheaf £xt^{F, F). To do this, we first apply the con- 
travariant functor 'Hom{—,F'^'^) to the sequence ([25]) . Since 'Hom{i^L,F'''') = 0 
(the first sheaf is torsion, while the second is locally free), one concludes that 
nom{F'''',F'^'') 'Hom{F,F'^'^) and 

8xt\iL.,L){2),F'''') ~ £xt\L.,Or, Opa) © (F'"'' © (t*F-^))(-2) = 0, 
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by ([24]). 

Notice that 'Hom{F,(i.,,L){2)) ~ F,OT{{2m — l)pt)). Applying the 

functor (.*( — ( 8 ) (.,Or) to the sequence ( 1 ^ one obtains the following exact sequence 
of sheaves on T: 

(28) 0 ^ i*rori((i,L)( 2 ), ^ F\t ^ Or(( 2 m - l)pt) ^ 0. 

Breaking it into two short exact sequences, one obtains, since 

(29) 0 ^ Frori((i*L)(2), i*C>r) ^ F|r ^ G ^ 0 
and 

(30) 0^G^O®2^Or((2m-l)pt)^0. 

One concludes from sequence (1501) that G ~ Or(—(2m — l)pt). Moreover, since by 

(EU 

t*Tori((t*L)(2), i*Gr) — A^r/pa <8 Or(( 2 m — l)pt) ~ O®^ for m ^ 2 , 

and 

GTbri((6*L)(2), i*Gr) — A^r/pa ® Gr(3pt) cs Or(pt) © Gr(—pt) for m = 2, 
it follows from sequence (1501) that 

F|r — © Or(—( 2 m — l)pt) for m 2 , 

F|r Gr(pt) © Gr(—pt) © Gr(—3pt) for m = 2. 

We then conclude that 

(31) 'Hom{F, (6*L)(2)) ~ t*Or((2m — l)pt)®^ © 6*Gr((4m — 2)pt) for m ^ 2, 

(32) 'Hom{F, (t*L)(2)) ~ t*Gr(2pt) © i*Gr(4pt) © t*Gr( 6 pt) for m = 2. 

Now, by applying the functor 'Hom{—,F'''^) to (1501) . one concludes that 
£xt^{F,F'''') cs fa:t^((t*L)(2),F'''^). However, 

£xt^{{i^L){2),F'''') ~ £xt^{L^OT{-pt.),Ov^) ® F'^''{-2) ~ 

£’a;t^(t*Gr, Gpa) © t*Or(pt) © F'^''(— 2 ). 

Thus, by (|22l) . (l24l) and since F'^'^jc — G®^, we obtain 

(33) £’rf^(F,F'''') cst*Or((2m-l)pt)®2. 

Finally, we apply the functor ((.*F)(2)) to (l25l) . using (l23l) and the iso¬ 

morphism £’a;t^((t*F)( 2 ), (t*F)( 2 )) ~ £xP{L^:0^, i-*Or), and we see that 

(34) £xt^(F,{i^L){2)) - £xf{{i^L){2),{i^L){2)) ~ 6 *detAfr/pa. 

Thus, in view of (155|) . we have 

(35) £xt^{F, (t*F)(2)) ~ t,Gr((4m - 2)pt). 

Substituting (l3T1) - (l33l) and (l35l) into (ITOl) . we obtain the exact sequence 

0 —)• i*Or((4m — 2)pt) —)• i*Or((2m — l)pt)®^ © t*Gr((4m — 2)pt) —)> 

£xt^(F, F) —!> t*Gr((2m — l)pt)®^ —t*Or((4m — 2)pt) —^ 0 for m ^ 2, 
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and 

0 —)• 6 ,C>r( 6 pt) ^ (.*C)r(2pt) ©t*Or(4pt) ©i*C)r( 6 pt) —>■ £xt^{F,F) —)• 

(.*Or(3pt)®^ ^ i*Or( 6 pt) 0 for m = 2 . 
Breaking these into three short exact sequences, one obtains: 

(36) 0 ^ Gi —>■ t*Gr((2TO — l)pt)®^ —>• 6*Or((4TO — 2)pt) —>• 0 for m > 1, 

(37) 0 ^ G 2 £xt^ (F, F) Gi ^ 0, 

(38) 0 —)■ i*Gr((4m — 2)pt) —>■ 

t*Gr(( 2 m — l)pt)®^ © i*Or((4m — 2 )pt) —)• G 2 —0 for m ^ 2 , 

and 

(39) 0 —>■ t*Or( 6 pt) —>• t*Or(2pt) © t*Or(4pt) © t*Gr( 6 pt) —>■ G 2 —>■ 0 for m = 2. 

From (l36l) one concludes that Gi ~ while (l38l) and (l3^ impliy that G 2 — 

t*Gr((2m — l)pt)®^ for m ^ 2 and G 2 — i*Gr(2pt) © t*Or(4pt) for m = 2. Then 
( 1 ^ yields 

£xt^{F, F) ~ L^Orii^m — l)pt)®^ © m 7 ^ 2, 

£xt^{F, F) ~ 6*Gr(2pt) © t*Gr(4pt) © t*Gr, m = 2. 

It then follows that 

h^{£xt^{F,F))=4:m + l and h^{£xt^{F, F)) = 0. 

We conclude from Lemma [5.21 that Ext^(F, F) = 0 and 

dim Ext^ {F,F) = 4m + 1 + 8 n — 4m — 4 = 8 n — 3 if n > m, 

dimExt^(F, F) = 4m + 1 + 4m — 4 = 8 n — 3 if n = m, 
as desired. □ 


7. Sheaves in 'D{m,n) as limits of instantons 

The goal of this section is to prove that the varieties 2?(m, n) are contained in 
the instanton boundary dl{n). We begin with the following technical lemma. 

Lemma 7.1. Let C be a smooth irreducible curve with a marked point 0, and set 
B:=C X P^. Let F and G be Os-sheaves, flat over C and such that F is locally 
free along Supp(G). Denote P^* = {t} x P^, and 

Gt = G|{t}xP3, Ft = F||t}xP3 for t G C. 

Assume that, for each t G C, 

(40) H\nom{Ft,Gt)) = 0, i>l. 

Assume that s : Fq —>■ Gq is an epimorphism. Then, after possibly shrinking C, 
s extends to an epimorhism s : F ^ G. 
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Proof. The condition that F is locally free along Supp(G) implies that 8xt^{F, G) = 
0. Thus applying the functor 'Hom{F, —) to the short exact sequence 

0 ^ G ^ G ^ Gt ^ 0, t G G, 

where Q is the local parameter of Oc,t-, we obtain the short exact sequence 

(41) 0-AH^H^Hom(F,Gt)^0, t G G, 

in which H denotes the sheaf 'Hom{F, G). Since F is locally free along Supp(Gt) C 
Supp(G), we obtain that 

(42) nomiF,Gt)-nom{Ft,Gt)-U\p.^, t G C. 

This means that m can be rewritten as the short exact sequence 

(43) 0 ^ H ^ H -G H|p3^ ^ 0 

obtained by applying the functor — 0 H to the short exact sequence 

O^Ob'^Ob^Ops^ 0 . 

This yields 7~bri(H, GpaJ = 0 for any t G C. 

The last equality means that the H is flat over G. Furthermore, the condition 
(l40)) in view of (|4i|) can be rewritten as H^{'Hom{Ft,Gt)) =0, i > 1. Thus, 
by Base Change, we obtain that = 0 for j > 1, where p : B —>• G is the 

projection. As a corollary, applying to (IT51) for t = 0 and using (H^ . we obtain 

0 —>■ p*H —p*H A p^.'Hom{Fo, Go) —>■ 0. 

Since p^,'Hom{Fo, Go) is supported at 0, it follows that, after possibly shrinking G, 
the homomorphism of sections 

h°{e) : i/°(p*H) ^ H°{p^'Hom{Fo,Go)) 

is surjective. However, this epimorphism canonically coincides with the epimor- 
phism Hom(F, G) ^ Hom(Fo,Go). Hence, the homomorphism s G i?om(Fo,Go), 
from the hypothesis of the lemma extends to a morphism s G Hom(F, G). In addi¬ 
tion, as s is an epimorphism, again, shrinking G if necessary, we may assume that 
s is an epimorphism as well. □ 

Proposition 7.2. 22(1, n) C dX{n) for n > 1. 

Proof. Fix a disjoint union of n -|- 1 lines A = |J in P^. The extensions of 

0<z<n 

Gp3-sheaves of the form 

(44) 0 Op3(-l) ^ A ^/a_p3(1) ^ 0 

are classified by the vector space V = Ext^(/A.p3(l), Gp3(—1)). It is easy to see that 
any nontrivial extension (1441) defines an instanton sheaf E; when E is locally free, 
it is called a ’t Hooft instanton. A standard computation gives an isomorphism 

(45) © H°{Oi,). 

0<i<n 

Under this isomorphism, any point x in U can be represented by its coordinates 
X = {to, ...,tn), ti G F['^{Otf) = C. By O Proposition 3.1], there exists a universal 
(flat) family of extensions (l44ll parametrized by the affine space V = Restrict 

it to the line defined by = {(t, 1,..., 1) | t G C}, and denote by E = {AtjtGAi 
the thus obtained family of instanton sheaves with base A^. It follows from the 
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construction of the isomorphism (j45p that Et is locally free and \Et] G 2i(n) for 
0 ^ t G A^. For t = 0, the sheaf Eq is not locally free. By Theorem 12.21 Eq'' is an 
instanton bundle, [Ag'^] G I{n — 1). In fact, it fits into the short exact sequence 

(46) 0 —>■ Op3(—1) —>■ Fig''—>■ JyVj^p3(l) 0, Ai = I I £i, 

l<i<n 

so it is a’t Hooft instanton. 

We thus obtain a morphism (j> : ^ t M- [Et], and this proves that 

[Eo] G dlin). 

The exact triples for E = Eq and (1151) yield the exact triple 

0 Eq Eq'' —^ O^p(pt) —>■ 0, 

which shows that [Aq] G V{l,n). By Proposition 16.51 Ext^(£'o, Aq) = 0. So 
[i?o] is a smooth point of A4(n), in particular, [Ag] does not lie in the inter¬ 
section of two components of M(n). Hence X>(l,n), (D(l,n) are entirely con¬ 
tained in the component I(n). As none of the sheaves in 'D{l,n) is locally free, 
I?(l, n) C 11(1, n) C 9I(n). □ 

Let now n > m > 2. Fix a disjoint union Fi = F'U^i in P^, where F' is a smooth 
irreducible rational curve of degree to — 1 and is a line, and let ti : Fi ^ P^ 
be the embedding. Consider the On-sheaf Li = Or'(—pt) © 0£j(—pt). Fix an 
instanton bundle E G T{n — to) such that 

(47) Ain =. Of. 

the existence of such a bundle A follows from the above. Let us fix an epimorphism 
Cl : A ^ (ti*Ai)(2), and let the sheaf Ai be defined by the short exact sequence 

(48) 0 ^ Ai ^ A-S4 (inAi)(2)0. 

Proposition 7.3. Let n > m > 2, and assume that T>(m — l,n — 1) C dlin — 1). 
Let Ai he the Ops-sheaf defined by 14^ - Then [Ai] G dX(n). 

Proof. Let E' be the kernel of the composition 

Si : A —((,i*A)(2) —ii*Or'((2 to — 3)pt), 

where e' is the projection onto the direct summand. We thus obtain a short exact 
sequence 

(49) 0 ^ A'A ^ ii*Or'((2m-3)pt) ^ 0, 
which shows, since [A] G T{n — to), that 

[A'] G V{m-l,n-l). 

Furthermore, since Fi is a disjoint union of F' and fi, the last isomorphism in (1471) 
yields 

(50) A'I,, Of. 

Besides, (1151) and (1151) imply the exact triple 

(51) 0 ^ Ai ^ A' 4 ii^Oe(pt) 0. 
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By hypothesis, [J^'] is in dX{n — 1). Hence we can find a smooth irreducible 
curve C with marked point 0 and a pa-sheaf F\ flat over C, such that 

(52) [F'|{y}xP3] eX(n-l), yeC\{0}, F'|{o}xP3 ~ F'. 

By (ITtI) . F' is locally free along £i, and by (l5^ . E := F' is locally free along 
Supp(G), where G = Li^{Oc ^ Gfi(pt)) and /-i = id x : G x £i ^ C x 

is the embedding. Moreover, (gzl) implies that, after possibly shrinking C, we may 
assume that E|{j,}xfi — for ah y & C. This together with the definition of G 
yields (HOI) . Hence E, G satisfy the hypothesis of Lemma mi and there exists an 
epimorphism s'| ; E ^ G extending the epimorphism s' in (|5ip . We thus obtain 
the short exact sequence 

(53) O^Fi-^F'4/,i4C)c^G£i(pt)) ^0 
extending dsn, that is 

(54) F i|{o}xp3 ~ Fi. 

Restricting ([5^ to {?/}xP^ for y £ C, weobtain, by (l5^ . that [Fi|{y}.xP3] £ ^(Ij^r) 
ior y £ C \ {0}. Moreover, Fi is stable by Corollary 14.21 and Lemma l46l so [Fi] £ 
M{n). This together with ([54)l implies that [Fi] £ 'D{l,n), and the proposition 
follows from Proposition [721 D 

Let now n > m > 2, [E] £ I(n — m), let To = T' U Iq, where T' is a smooth 
rational curve of degree m — 1, £o is a line intersecting T' quasi-transversely at one 
point, say, x, and let the following properties hold: 

(55) iVr,/p3 ~ C>r'((2TO - 3)pt)®2, 

(56) E\r> 0, EU, c, 

Note that ([55]) and the first two isomorphism in (1561) mean, in the notation of 
Section [U that T' S 7?.q(to — l)^;. 

We will now treat the transform Eq of the instanton bundle E along the non- 
invertible sheaf C>f(—pt) © Or'(~Pf) on Tq. 

Proposition 7.4. Let n> m>2, and let E, Tq he as above. Set Lq = Gr'(—pt)© 
pt) and consider a sheaf Eq fitting into an exact sequence 

(57) 0 —>■ Fq —>■ F —(;,o*Lo)(2) —0, 

where ip ^ Bg ^ P^ is the natural embedding. Assume that F(m —l,n—1) C 
dl{n — 1). Then [Fg] S dl{n). 

Proof. We can include Tg in a one-parameter family of curves Pgr = {r„ = T' U 
^ujuGU over a smooth irreducuble curve U such that T' n = 0 for any u £ 
U \ {0}. Shrinking U, if necessary, we may assume by semicontinuity and the last 
isomorphism in ([55]) that 

(58) F|^„ ~ 0®2^ u£U. 

The union tjj = ^ surface meeting T' only at x. We may assume that 

this intersection is transverse and that the lines £„ do not intersect each other (for 
example, we can start the construction from a family of lines £u which is one of the 
two families of rectilinear generators of a smooth quadric, and then £u is an open 
subset of this quadric). We have Pj/ = ({7 x P') U£u- 
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Consider the following -sheaf: 

(59) Lu = Ou Or'(~Pt) © (C’p3(—l)|f(;)- 
Then for each u (£ U, we have 

Lu ■= LjjIuxp^ — © C’^„(-pt)- 

Let j : r (7 ?7 X be the natural embedding. Then j|{o}xP 3 = io, and by (1551) . a 

surjection E -S- lo*Lo{2) from (1571) extends to a surjection e : Ou ^ E ^ j^Lu{2), 
where twisting a sheaf on F;/ or on [/ x by an integer k means tensoring it by 
Ou ^ Op3{k). The ©[/xps-sheaf Eu ■= kere fits in the exact triple 

0^ Eu ^Ou^E ^ 3 ,Lu{2) 0 . 

Let Eu := Eu\{u}xp^ for u € U. If u € U \ {0}, then r„ is a disjoint union 
r' U iu, so the result of Proposition 17.31 holds for Fi = Eu- Hence [Eu] G dl{n) 
for all It G U\ {0}. For u = 0, the stability of Eq is assured by Corollary 14.21 
and Lemma HU so that [Eq] G M(n), and by closedness of dl{n), we also have 
[Eq] G dl{n). □ 

Remark 7.5. The family of curves r„ used in the proof is not flat, but it carries 
a {7-flat family of pure rank-1 sheaves that is a part of degeneration data of a 
[/-flat family of instanton sheaves Eu- 

Note that, by construction, Eq fits in the exact triple 

(60) 0 ^ Eq ^ E ^ L^{Or'{{‘2m — 3)pt) 0 ©^^(pt)) ^ 0. 

Proposition 7.6. Under the hypothesis of Proposition [7^ Exff{Eo,Eo) = 0, so 
that [ifo] is a smooth point of M{n). 

Proof. Denote L' := t*(Or'((2m — 3)pt)) and Lq := t^,{Oeg{\t)). Then (1501) implies 
the exact triples 

(61) O^F^E^L'^0, 

(62) 0 —y Eq —^ F —y Lq —y 0, 

where F is the kernel of the composition E ^ L' (B Lq ^ >> V. Applying to (l62l) 
the functor Ext'(—,i/o) we obtain the exact sequence 

(63) Ext^(F, Aq) ^ Ext^(il/o, E/q) —^ Ext^(Lo) A'd); 

By Serre-Grothendieck duality, Ext^(Lo,-E'o) = Hom(ifo, Eo(—4pt))'". Applying 
Rom(—, Lo(—4pt)) to (l60l) and using (l56l) . we obtain the exact sequence 

0 ^ O£o(-4pt) ^ 2C)f„(-3pt) ^ Hom(E;o,0£„(-3pt)) ^ (-3pt)®2©k(cr) ^ 0 

where k(a;) cs fxf^(L', Lo(~4pt)) ~ SxU{L',L q(—4:\£)) is a skyscraper of 
length 1 at the point cc = T' n [q- Since (!l^u(—3pt) has no torsion as 
an Ofp-module, ?7om(£’o, (—3pt)) is also a torsion free Ofg-module, hence 

7[om(£'o,(!lfo(-3pt)) ~ ©^^(-pt) ©Ofo(-3pt)®2 and 

(64) Ext3(Lo, Ao) = Hom(E;o,Eo(-4pt))" = i7°(7[om(£;o, Of„(-3pt)))'^ = 0. 

Next, since L' has homological dimension 2 and E is locally free, F has homological 
dimension 1. Therefore, 

(65) 


£xt^iF,EQ) = 0 . 
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Also, since E is locally free, (IHTI) implies that 

( 66 ) £xt^{F, Eo) = £xt^{L\ Eq). 

Next, (1551) implies that 

Ext^{L',L') ~ 7 Vr'/p 3 ~ C>r'((2m - 3)pt)®2, 

^ ^ L') ~ detiVrypa ~ C>r'((4m — 6 )pt). 

Similarly, by (|55)) . we have 

(68) £xf{L',E) ~ detiVr//p 3 O ((L')®^)" - Or'((2m - 3)pt)®2. 

Now applying £xt’{L', —) to (ISOl) . we obtain the exact sequence 

£xt^{L\E ® Lo) ^£xt^{L',Eo) ^£xf{L',E) A £xf{L',L' ® Lq). 

Using dSIl), dMI) and the relations £xt^{L', Lq) ~ £xt^{L',L q) ~ k(ai), we rewrite 
the last sequence as follows: 

C>r'((2m-3)pt)®2 0 k(x) 4£:a:t2(L',Uo) ^Or'((2m-3)pt)®2 4 

Or'((4m — 6 )pt) © k(a;) —0. 

It implies that ker(5) is an Op'-sheaf of degree > —1, so h^(ker((5)) = 0. Similarly, 
h^(im( 7 )) = 0. Hence E[^{£xt‘^{L', Eq)) = 0, and by (l 66 l) . 

(69) H\£xt^{F,EQ)) = 0. 

Next, as E is locally free, (l60t yields the exact triple 

H^{nom{E, L' © Lo)) ^ H^{Hom{E, Eq)) H‘^{'Hom{E, E)). 

From (IMl) and the definition of L' and Lq, it follows that H^{'Hom{E, L'©Lo)) = 0. 
Besides, since [E] € T{n — m), it follows that H^('Hom{E, E)) = 0. Thus we have 

(70) H'^{nom{E,Eo)) = 0. 

Applying 'Hom{—,Eo) to (ICTl) . we obtain the exact triple 0 — 'Hom{E, Eq) —>■ 
'Hom{F, Eq) -a £xt^{L',E q). As Supp(L') = F', it follows that i7^(im(e)) = 0, and 
the last exact triple together with (1701) yields E['^{'Hom{F, Eq)) = 0. This equal¬ 
ity together with (1651) . (l69l) and the spectral sequence E^'^ = E[p{£x£^{F, Eq)) ^ 
Ext*(F, Aq) implies that Ext^(F, Aq) = 0. By (l63l) and (l64l) . we also have 
Ext^(il/o, F/q) = 0. fH 

Proposition 7.7. Let n > m > 2, and assume that D{m — 1, n — 1) C dX{n — 1). 
Then V{m, n) C I{n). 

Proof. Take A, Fq = F' U^o as in Propositions 17.41 and 17.61 and consider the exten¬ 
sions of Ops-sheaves of the form 

(71) 0 —>■ i*Ofo(pt) ^ M —>• i*Or'((2m — 3)pt) —0. 

We have £xtQ^^{L^Or>{{2m — 3)pt), t*0^g(pt)) ~ k(a;), where a; = F' D £oj and 
Ext^^g ((,,Or'((2m —3)pt), t*Ofu(pt)) ~ k. There is a universal family of extensions 
(1711) over the affine line = V(Extp 3 ('-*Or'(( 2 m — 3)pt), (pt))'^) (see [TJ 

Proposition 3.1]): 

(72) 0 ^ ^*{0^1 Kl Of(,(pt)) M ^ Kl Or'((2m — 3)pt)) —>■ 0, 

where l = idx x io and to : Fq ^ is the embedding. 
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Let Mt = t G A^. For t — Q the extension (ITT]) splits, i.e. 

(73) Mo ~ t*Or'((2m - 3)pt) © i*C>4(pt), 
and we may rewrite the triple (|60p in the form 

(74) 0 ^ Ao ^ A 4 Mo 0. 

On the other hand, for any < G \ {0}, the sheaf M := Mt is a locally free 
Ofo- sheaf fitting in the exact triple (EJ. Take an arbitrary open subset T of A^ 
containing 0. Then the curve T and the sheaves F Ot ^ E and G := M satisfy 
the hypothesis of Lemma 17.11 hence by this Lemma, after possibly shrinking T, 
the epimorphism s in (TTH) extends to an epimorphism s : Ot ^ E ^ M. We thus 
obtain the exact triple 

0 —y Et —y Ot ^ E —^ AL —y 0. 

Restricting this triple to any point t GT and denoting Et = ET\{t}xP^j we obtain 
an exact triple 

(75) 0 ^ Et ^ E ^ Mt ^ 0, teT. 

By Corollary 14.21 and Lemma 14.61 Et is stable for any t G T. We thus have a 
well-defined morphism (j) : T ^ M.(ri) given by 1 1 — [Et\- 

For t ^ 0, the sheaf Mt is a locally free Oro -sheaf fitting in (ITT]) . Hence 

(76) Mt|r' ^ i*C>r'((2m - 3)pt), Mt\ta - i*Ot„{2^). 

Next, by Proposition 17.61 [Ao] is a smooth point of M(n). In addition, since 
the triples (l60)) and (l74)) coincide, it follows that [Ag] G dl{n) by Proposition 17.41 
Thus, 

(77) [Ag] G dl{n) \ Sing Ad (n). 

Fix a point ti G T \ {0}, denote Mg := Mt^, Ag := Et^, and rewrite the triple 
(1751) for t = ti: 

(78) 0 ^ Ag A 4 Mg 0. 

Now, as in Lemma l6Tl one can see that there exists a family of curves {Ff,}bgB, 
parametrized by a curve B with a marked point 0 G B, such that Fg = F' U .^g and 
Ff, is smooth for b G A \ {0}, and such that Mg deforms into an invertible sheaf 
Mb of degre 2m — 1 on F;, for 6 G A \ {0}. Denote by Lb the embedding F;, ^ 
for b G B. Let F —>■ A be the family {Fbjbgs and l = {Lb}bGB : F ^ A x P^ the 
embedding; for 6 = 0, we have the embedding tg : Fg ^ P^ defined earlier. The 
family of sheaves {Mb}bGB constitutes an invertible Or-sheaf M, so that is 
a OBxP=*-sheaf, flat over A, and the sheaves Mb := L^,M\^b}xP^^ b G B, satisfy the 
relations 

(79) Mo = Mt,, Mb~tb40r,(2m-3)pt), & G A \ {0}. 

Since Ajpo — O®^ by (l56l) . we may assume, after shrinking A if necessary, that 

(80) E\r,o^Of^, bGB. 

Formulas (l7^ and (l80l) show that the curve T = B and the sheaves F := Ob ^ E 
and G := satisfy the hypothesis of Lemma 17.11 Hence by this Lemma, after 
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possibly shrinking B, the epimorphism e in (j74ll extends to an epimorphism e : 
Ob ^ E ^ providing a short exact sequence 

0 —^ Ob ^ E A- l^M —>• 0. 

Restricting it to any b € B and denoting Ef, = £^|{5}xp3, we obtain a short exact 
sequence 

(81) 0 ^ Eb ^ E ^ Mb ^ 0, b e B. 

Since [E] G I{n — m), we deduce from (1751) that Eb is stable for any b € B hy 
Corollarv l4.2l and Lemmas 14.3114.61 We thus have a well-defined morphism (p : B ^ 
M{n), given by 6 M- [Eb]- Now dT^ - dMI) imply that [Eb] G V{m, n) for 0 ^ & G B. 
Hence B C V{m,n). In particular, [Et^] = [So] G V{m,n), ti G r\{0}. Therefore, 
T C 'D{m,n) and, in particular, [Sq] G 'D{m,n). This together with (iTT)) yields 

Vijn, n) n {dl{n) \ SingAI(n)) ^ 0. 

From the irreducibility of T>(jn, n), we deduce that T>(rn., n) C dX(n). □ 

We are finally ready to complete the proof of the main result of this section. 

Theorem 7.8. For each n > 2 and each m = 1 ,.. . ,n — 1 , 'D{m,n) C dlin). 

Proof. The result follows by induction on m. For to = 1, the assertion is true by 
Proposition 17.21 The induction step to — 1 to is provided by Proposition 17.71 
The theorem is proved. □ 

8. Elementary transformations along elliptic quartic curves 

In this section, we consider the case in which the curve E (notation from Section 
[SD is an elliptic quartic curve, that is a complete intersection of two hypersurfaces 
/i = 0 and /2 = 0 of degree 2. The minimal locally free resolution of its structure 
sheaf has the form 

(82) 0 ^ e>p3(-4) ^ C>p3(-2)®2 C>p3 ^ ^ 0, 

where i : S —>■ is the inclusion map. 

Following the procedure outlined by Proposition 13.11 let L G Pic°(E). If L is 
nontrivial, we have hP{i^L) = hP{T,, L) = 0, for p = 0,1, as desired. 

Let if be a locally free instanton sheaf of rank 2 and charge n. In order to perform 
an elementary transformation of E along E, we must find out whether there exists a 
surjective map E —>■ (i*L)(2). In Lemma l8.II below, we give the affirmative answer 
in the case when if is a null-correlation bundle, that is an instanton of charge 1. 

Breaking (1821) into short exact sequences and tensoring by any instanton bundle 
if, we obtain: 

0 E{-A) F;(-2)®2 E (g) is 0 and 0 E 0 is ^ E Ejs ^ 0, 

where Iy, denotes the ideal sheaf of E. 

Since h^{E{—2)) — hf{E{—2)) = 0, we conclude from the first sequence that 
H^{E 0 is) ~ H^{E{—F)) for every elliptic quartic curve E; moreover, if E is not 
the trivial instanton, then also h?{E®lY) = 0. Now, moving to the second sequence 
above, we obtain for a nontrivial instanton E: 

0 ^ H°{E[y) H‘^{E{-A)) H\E) H\E[y) ^ 0. 

It is not difficult to check that hf{E{—A)) = h^{E) = 2n — 2. 
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Lemma 8.1. If E is a null-correlation bundle on P^, then its restriction to any 
nonsingular elliptic quartic curve E ^ P^ is either of the form Lq © Lq for some 
nontrivial Lq € Pic(E), or the nontrivial extention of a nontrivial Lq G Pic°(E) of 
order 2 by itself. In either case, we have 

Hom(£;, (t*L)(2)) ~ Lq ® L( 8 pt)) © © L( 8 pt)). 

Proof. The restriction E\y. is a rank 2 bundle on E with trivial determinant; if E 
is a null-correlation bundle, then also /i°(E, £’|e) = ^^(E, E\-s) = 0. The first claim 
now follows from Atiyah’s classification of rank 2 bundles on nonsingular elliptic 
curves. 

Next, note that Hom(A, (t*L)(2)) ~ ^ L{8pt)). li E\^ ~Lo©Ao: 

the second claim follows immediately. On the orther hand, if Ajs is an extension 
of the form 

0 —> Lq —y E\^ —> Lq —> 0 with Lg ~ Oej 
then, twisting by L( 8 pt), we obtain the cohomology exact sequence 

0^£f°(E,Lo©L(8pt)) ^Lr°((A|E)'^©L( 8 pt)) ^7d°(E,Lo©L(8pt)) ^0, 
and the second claim also follows. □ 

In particular, we conclude that for any null-correlation bundle E and any elliptic 
quartic curve i : E P^, there exists a surjective map tp : E ^ (6»L)(2). The 
kernel sheaf E' := ker(/? is a rank 2 instanton of charge 5, since E has degree 4; 
note, in addition, that E' is /r-stable by Lemma im thus in particular [E'] G AI(5). 

Our next goals are evaluating the dimension and proving the generic smoothness 
of the locus of all the instanton sheaves obtained by elementary transformations 
from null-correlation bundles along elliptic quartic curves. 

Let Ea denote the set of nonsingular elliptic quartic curves in P^. It can be 
regarded as an open subset of the Grassmannian G{2,S'^V), where V is the 4- 
dimensional complex vector space such that P^ = P(P). This is a family of non¬ 
singular elliptic curves, so let j : J 4 —t Ea denote the relative Jacobian variety, i.e. 
j“^(E) = Pic°(E), and denote Ja '■= Ja \ {zero section}. A point of Jl can be 
thought of as a pair (E, [L]), in which E is a smooth elliptic quartic curve and L is 
a nontrivial line bundle of degree 0 on E, so that [L] G Pic°(E). Equivalently, it can 
be thought of as the isomorphism class of the sheaf on P^, where : E ^ P^ is 
the natural embedding. 

Note that Jjf is an irreducible, quasiprojective variety of dimension 17. 

Consider now the following subset of A4(5): 

Qs := {[E] G M(5) | [E^''] G 1(1), [(A"7A)(-2)] G 
Let Qq denote the closure of Qq in Ad (5). 

Theorem 8.2. Q 5 is an irreducible component o/Ad(5) of dimension 37, distinct 
from the instanton component I {It). 

Proof. Consider the map va : Qq ^ 1(1) x given by A >->• 

([A''''], [(A''''/A)(—2)]), and observe that it is surjective. Indeed, given a null- 
correlation bundle F G 1(1), and a nonsingular elliptic quartic curve t : E ^ P^ 
equipped with a nontrivial L G Pic*^(E), so that G iT}', we know from Lemma 
EH that there exists a surjective map (p : F ^ (t*L)(2). Then, as we have seen 
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above, E := ker(^ is an instanton sheaf from A4(5) such that E'''' ~ F and 
(t*L)(2), i.e. [E] e Qs. 

The fiber zu~^{F,l^L) consists precisely of all surjective maps F (6*L)(2) up 
to homothety, so it forms an open subset of P(Hom(T', (6*L)(2))), which, again by 
Lemma [8Tl has dimension 15 for every [F] e X(l) and every [t*L] e J 4 . 

It follows that Q 5 is an irreducible quasiprojective variety of dimension 

diml(l) + dim^TT + dimPHom(F, (6*L)(2)) = 37. 

We have concluded that Q 5 is an irreducible subvariety of At (5) of the same di¬ 
mension as 1(5) and whose generic point represents a non locally free instanton 
sheaf. This implies that Q 5 and 1(5) are distinct components of A((5). □ 

In particular, we have the following interesting consequence. 

Corollary 8.3. The moduli space of instanton sheaves of rank 2 and charge 5 is 
reducible. 

Remark 8.4. It is not clear, however, whether the moduli space of instanton 
sheaves of rank 2 and charge 5 is connected; in other words, we do not know whether 
the intersection Q n T(5) contains instanton sheaves. 

Finally, it is interesting to note that the generic point of Q is a smooth point 
of 7W(5). 

Proposition 8.5. Let F be an instanton sheaf obtained, as above, by an elementary 
transformation of a null-correlation bundle along a pair (E, L) where E is an elliptic 
guartic curve in P^ and [L\ € J^, I? 9 ^ Os- Then dimExt^(F, F) = 37 and 
dimExt^(F, F) = 0, so [F] is a smooth point of A4(5). 

Proof. Eirst, note that, as E is a complete intersection of two quadrics, the isomor¬ 
phism (IMl) yields 

(83) SxfiF, (i*L)(2)) ~ (t,C>E)(4). 

Next, applying the functor 'Hom{—,E) to the sequence 

0 ^ F F (t*L)(2) 0, 

where F := F'^'^ is a null-correlation bundle, and using the isomorphism 
£xf^{0-£.,Of.3) ~ L„ det As/p 3 ~ (6*(!Ie)( 4), we obtain 

(84) £xt\F,E)-£xt‘^{{i,L){2),E) - (i,L-i)(-2) 0 F|e 0 Ops) 

cs(t,L-i)( 2 )(g)F|E. 

Next, using the isomorphism Fori((6*L)(2), 6 *Oe) ~ (t*L)(2) 0 ~ 

similarly to (1^51) . we obtain an exact sequence 

0 ^ ^ F|s ^ F|e ^ (t*L)( 2 ) ^ 0 . 

Since detFjs — Os, it follows that 

(85) ker {F|s ^ (t*T)( 2 )} ~ ( 6 *L-i)(- 2 ). 

Hence the above exact sequence yields the following exact triple: 

0 ^ 6*L®2 ^ F|e ^ (i*L-^)(-2) ^ 0. 

As G it follows that /i^((t*L^)(2)) = /i^(E,L^( 8 pt)) = 0. There¬ 

fore the last sequence splits, i.e. F|s ~ (.*L®^ © ((.*T“^)(—2). This yields 
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'Hom{F,{uL){2)) ~ ((,*0®^)(2) © ((.*L^)(4). Substituting this relation together 
with (|M)l and (IMl) into ([T9]), we obtain the exact sequence 

0 (i*L^)(4) ^ t*C>E( 2 )® 2 © (t*L 2 )( 4 ) ^ £xt^{F,F) 

( 6 *L- 1 )( 2 ) © E\^ ^ (t*OE)(4) ^ 0 . 

Similarly to (|55|) . one has ker {(6*L“^)(2) ©iHls ^ (t*C)i;)(4)} ~ Thus the 

last exact sequence provides the exact triple 

0 ^ (i*C)E)(2)®2 ^ £xt^{F, F) i,L-^ 0. 

Moreover, since /i^((t*L^)(2)®^) = 0, this triple splits, and 
£xt\F, F) ~ (t*OE)(2)®2 © 6*L-2. 

Since by assumption L~^ 9 ^ Os, it follows that h^{Y,,L~‘^) = 0, and the above 
isomorphism implies h^{£xt^{F,F)) = 0. This together with Lemma 15^ yields the 
Proposition. □ 

We conclude by remarking that one can also perform elementary transformations 
of the trivial bundle along plane cubic curves, a fact also realized by Perrin in 
[igiiT], as mentioned in the Introduction. 

Indeed, let t : S —>■ be a plane cubic curve. For any L S Pic°(E) one 

can find surjective morphisms ip : 0®3 —> ( 6 *L)( 2 ), since Hom( 0 ® 2 ,(t,L)( 2 )) - 
iL°(E, L( 6 pt))®^. Assuming that L is nontrivial, the kernel sheaf E' := ker(/? is an 
instanton sheaf of charge 3; it is also stable, by Lemma l47^ therefore [E'] G A4(3). 

Remark 8.6. One can also consider surjective morphisms ip : 0®3 ((.*(!Ie)(2). 

In this case, the kernel E' ker ip is a stable rank 2 torsion free sheaf with ci {E') = 
cs^E') = 0 and C 2 {E') = 3, but is not an instanton sheaf. 

Next, let now £3 be the set of nonsingular plane cubic curves, regarded as an 
open subset of P( 5 '^(T(p 3 )v (—1))), let J 3 be the relative Jacobian over £ 3 , and J 3 
the complement of the zero section. Consider the following set: 

Q 3 := m e M{3) I E'''' cs [{E''''/E)i-2)] G J^- 

Similarly to Theorem 18.21 one can show that Q 3 is an irreducible component of 
Al(3) of dimension 

dimj73° + L( 6 pt)®^) — dimAut( 0 ® 3 ^) = 21 . 

It follows that Qs does not coincide with the instanton component X(3), since 
diml(3) = 21 as well. 

The proof of Proposition 18.51 also works in this case, and one can show that the 
instanton sheaves obtained as above, by elementary transformations of the trivial 
rank 2 bundle along a pair (S, L) where S is a plane cubic curve in P^ and [L] G J 3 , 
Os, are smooth points of AI(3). 

Furthermore, as mentioned at the Introduction, Perrin provides additional infor¬ 
mation on the intersection Q 3 (~lX(3) of these two irreducible components of A4(3). 
In fact, he has shown that if L is a theta characteristic on E (i.e. if = Os), then 
the sheaves E given by short exact sequences of the form 

0 —y E — y 0 ® 3 ^ — y (i*L)(2) — y 0 

lie in the closure of the instanton component 1(3), and form an irreducible compo¬ 
nent of the instanton boundary dl{3), see [TH] Thm. 0.1]. 
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